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Literature Review on Questionnaires (i.c.. Validation, etc.) 
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Etter, J., Due, 
T.V., and 
Pemeger, 
T.V. 


Addiction 
(1999, volume 
94, issue 2, p. 
269-281) 


643 students, 
academic, and 
administrative 
staff suppliers 
at baseline and 
482 at follow- 


Two sessions, 7 
months apart 


To assess the validity of 
the Fagerstrom test for 
nicotine independence 
(FTND) and of short-form 
of this questionnaire, the 
Heaviness of Smoking 
Index (HIS) in a 
population of relatively 
light smokers 


* FTND - a six-item shortened version of the FTQ, excluding 
litems on nicotine yield of cigarettes and inhalation (responses 
are added to compute a score ranging from 0 to 10 with 010 
! being the most dependent smokers) * HIS - shorter, two-item 
Version of the same test (scored from 0-6) * Content validity 
die capacity of a test to represent adequately the concept 
under investigation; each aspect of addiction to cigarettes 
should be covered * Score distributions - good scales and 
items should produce variability, minimal floor and ceiling 
effects, and small proportions of missing answers * Pros of 
smoking scale - consists of items that measure withdrawal 
symptoms, relief of withdrawal symptoms, and self-perceived 
dependence 
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Etter, J., Le 
Houezec, J., 


Neuropsychoph 

armacology 


3009 smokers 
with 578 
retesting after 
18 days, 990 
providing 


and Pemeger, (2003, volume follow-up data 


28, p, 359-370) 


after 45 days, 
and 105 
providing 
saliva cotinine 


Questionnaire 
development 
over several 
years through a 
6 stage process 


To develop a new, self- 
administered measure of 
cigarette dependence, and 
to assess its validity 


* Other indicators of dependence - cigarettes per day, 
minutes to first cigarette of the day, 0-100 scale of self- 
perceived dependence, occasional versus daily smoking, sell- 
perceived difficulty to quit, and the strength of the urge to 
smoke during the last quit attempt 
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Content validity, score distributions, validity of internal structure of the instrument 
using the Velicer’s Minimum Average Partial MAP test and Horn's parallel analysis, 
internal consistency of alpha > 0.7, test-retest reliability, predictive validity, 
correlation with saliva cotinine, correlation with quitting seif-efficacy, correlation 
with quit attempts in the past year, correlation with withdrawal symptom questions 
and with self-perceived dependence; Univariate logistic regression models, 
univariate linear regression model, odds ratios, regression coefficients, likelihood 
ratio chi square tests, and adjusted R-squared statistics used 


* Both composite scales fail to assess several recognized aspects of 
tobacco dependence * Both tests had important floor effect with, 

1 respectively, 55% and 63% of participants with scores equal to 0 or 1 on 
■ these scales * Two of the FTND items (Difficult-to-refrain and Hate- 
most-lo-give-up) had poor psychometric properties * Even though FTND 
and HSI correlated about as expected with criterion variables, the number 
of cigarettes smoked per day performed better than either composite scale 
on most validation criteria 
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Several tests given and systematically reduced with elimination of floor effect and 
ceiling effects, items with high proportions of missing or "Don’t know" answers, and 
those with weak associations with other indicators of dependence; retests given to 
lassess reliability, correlation coefficients determined; assessment of whether intended 
measure of dependence predicted smoking cessation evaluated through follow-up; 
correlation of test items with cotinine content; factor analysis used to assess the 
factorial structure of the data (Velicer's MAP test, Horn's parallel analysis); tests 
compared to the categories in qualitative data and to DSM-IV and ICD-10 
definitions of dependence to assess content validity; relationships evaluated for 
construct validity, differences between baseline and retest scores among different 
groups of smokers compared to evaluate sensitivity to change; univariate linear 
regression models and t-tesls used, as well as ANOVA models and Fischer's z 

transformations 


* Performance on an 114-item test resulted in a 12-item scale labeled the Cigarette 
Dependence Seale (CDS-12) and in a 5-item version of this scale (CDS-5) * Except for 
tolerance, CDS-12 covers the main components of DSM-IV and ICD-10 definitions of 
dependence; compulsion, withdrawal symptoms, loss of control, time allocation, neglect uf 
other activities, and persistence despite harm * CDS-5 has similar measurement properties 
but less comprehensive content * Both scales had a high test-retest reliability and a high 
internal consistency * CDS-12 scores were higher in daily smokers than in occasional 
smoker, and were associated with the strength of the urge to smoke during the last quit 
attempt and with saliva cotinine * CDS-12 and CDS-5 scores decreased in daily smokers 
who switched to occasional smoking at 18-day retest * Dependence scores did not predict 
smoking abstinence at follow-up * CDS-12 and CDS-5 are reliable measure of cigarette 
dependence which fulfill several criteria of content validity and construct validity and are 
sensitive to change over time * Strength of most associations better for adults than for teem 


PMUSA [Confidential] 


Psychometric Analysis of Smoking Questionnaires 


Phan 6,1/22/2004 


Source: https://www.industrydocuments.ucsf.edu/docs/xgmj0001 





PM3003732614 


Gareia-Leon, 
A., et al. 


The Spanish 
Journal of 
Psychology 
(2002, volume 
5, number 1, p. 
45-53) 


Study 1: 384 
university 
students 
initially (90 
males and 294 
females, mean 
age of 21.6) 
and 154 in 
follow-up (34 
males and 120 
females, mean 
age of 18.7 
years); Study 
2 : 57 male 
prison inmate 
and 93 male 
university 
students (mean 
age of 20.7 and 
19.5 years, 
respectively) 


45 minute test 
session for 
each giving of 
a questionnaire 


To examine the 


* AQ - 29-item instrument with 4 subscales to assess anger, 
hostility, verbal aggression, and physical aggression * Basic 
dimensions of anger: affective (made up of emotions such as anger 
or loathing), cognitive (consisting mainly of negative thoughts 
about human nature, resentment, and cynical distrust), and 
behavioral (Defined by various forms of aggression, such as 
physical or verbal) * Cook-Medley Hostility Scale (Ho) - 50 true-of 


psychometric properties I false items taken from the original MMI and is usually used as a 


of the Aggression 
Questionnaire (AQ) in 
Spain 


measurement of general hostility *Boss-Durkee Hostility 
Inventory (BDHI) - 75 true-or-false items, with eight subscales 
(assault, indirect hostility, irritability, negativism, resentment, 
suspicion, verbal hostility, and guilt) * Jenkins Activity Scale Form 
H (JASE-H) - 32 items to evaluate the Type A pattern, with four 
subscales of Hard Driving, Job Involvement, Impatience, and 
Hostility * The State-Trait Anger Expression Inventory (STAXI) - 
47 items assessing two dimensions of anger: anger-state and anger- 


Heatherton, 

T.G., British Journal 254 smokers 
Kozlowski, of Addicti on (average of 

L.T., Frecker, (1991, volume 33.5, 111 male 
R.C.. and 86, p. 1119- and 143 
Fagcrstrom, 1127) female) 

K. __ ___ 


female) 


One time 


To examine and refine the 
FQR by looking at the 
relation between each 
FTQ item and 
biochemical measures of 
heaviness of smoking 
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* Factor analysis shows four relevant factors; Verbal Aggression, Anger with Resentment, 
Physical Aggression, and Suspicion * subscales of the AQ showed internal consistency and 
stability over time * In comparison with the scales and subscales of the STAXT, the Ho, the 
BDHI, and the JASE-H, the AO was shown to evaluate some aspects of anger, such as 
Anger-Trait and Anger-Out, but not others, auch as Anger-ln or Anger-State * The AQ was 

* Ill Study 1, reliability, construct validity, test-retest and convergent validity were able to discriminate between common offenders and university Students * The subscales 
evaluated * In Study 2, ability Of the AQ to discriminate between criminal offenders of Verbal and Physical Aggression were correlated * The subscale of Anger with 

and university students was evaluated using one-way ANOVAs Resentment correlated with all other subscales * Men had significantly higher scores on 

Physical Aggression and Verbal Aggression, whereas women had significantly higher 
scores on Anger with Resentment * The Ho showed foe highest correlations with the total 
AQ score and with the subscales of Anger with Resentment and Suspicion * Both the total 
AQ score and all its subscales correlated strongly with the BDHI * Inmates scored 
significantly higher than did students in Physical Aggression 




* The nicotine rating item and the inhalation item were unrelated to any 

Relationship between biochemical measures and each question of FTQ, FTQ versus of the biochemical measures and these two items were primary 
the HIS, internal consistency, and factor structure (using the measure of sampling contributors to psychometric deficiencies in the FTQ * The revised 
adequacy) were examined scoring of time to the first cigarette of the day and number of cigarettes 

smoked per day improved the scale 
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* Fagerstrom Tolerance Questionnaire (FTQ) assesses the 
compulsion to use cigarettes to achieve pleasurable effects and to 
avoid withdrawal * Stanford Dependence Index (SDT) - adaptation 
of FTQ for youth * 45 new items - test items (hut emerged from 
To examine the test retest telephone consultation with experts on youth smoking, and focus 


O'Loughlin, 
J., Tarasuk, 
J., Diffanza, 
J., and 
Paradis, G. 


Annual 

Epidemiology 238 high 
(2002, volume school students 
12, p. 353-362) 


Two 45 
sessions a few 
weeks apart 


reliability, internal 
consistency, and 
convergent construct 
validity of selected 
measures of nicotine 
dependence among 
adolescents 


group interview with teenage smokers; categorized into five 
groupings of items: indicators of affect smoking, situational 
smoking, physical/psyehosocial dependence, control over smoking, 
and "other" * Hooked on Nicotine Checklist (HONC) - 10 items of 
Yes/No response, based on the theory that nicotine dependence in 
youth is associated with a loss of autonomy over their use of 
nicotine * Self-Medication Theory - dependence results from the 
use of drugs to self-medicate unpleasant affective states * Negative 
Reinforcement Theory - addictive l>ehavior is motivated by the 
desire to avoid withdrawal symptoms * Incentive-Sensitization 
Theory - repeated administration of nicotine renders the wanting 
pathway in the brain permanently hypersensitive 
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* Test-retest reliability was examined among past 3-monih smokers * Reliability of 
items with dichotomous response choices was computed with the Kappa statistic, 
which is a measure of agreement corrected for chance * For items with continuous 
or multi-level categorical response choices, intraclass correlation coefficients were 
used (ration of subject variance to total variance including both subject and random 
error variance) * The internal consistency of the HONC and SDI was measured 
using Cronbach’s alpha, a reliability coefficient that measures a single underlying 
construct * Convergent construct validity of measures against indicators of cigarette 
exposure including past 3-month smoking and number of cigarettes smoked per week 

was assessed 


* Test-retest reliabili ty among past 3-month smokers indicated good to 
excellent reliability coefficients for HONC items, except one item that 
tapped feelings of depression on 'withdrawal * The HONC and SDI 
demonstrated good internal consistency * Convergent construct validity 
against cigarette exposure was demonstrated tor the HONC, SDI, and 
most of the 45 new items * The HONC and SDI demonstrated excellent 
and good psychometric properties, respectively * Most of the 45 new 
items hold promise - 23 of the 45 showed very good or excellent test 
retest agreement, but there was variability in tire ability of individual 
items to differentiate between lower and higher exposure to smoking 
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131 adolescent 
volunteers in a 
Addictive smoking 

Behaviors cessation 

PfAifh nrnv 

’ (2000,volume program(49% Onetime 

et a . 25 ^ Ilum her 3 , p. male, 93 % 

429-433) White, mean 
age of 17.7 
years) 


To gain evidence of * Saliva cotinine - a metabolite of nicotine * Modified TTQ - 
validity for a nicotine FTQ questionnaire that does not include the question on 
dependence measure for brand preference, since adolescents are shown to have 
adolescent smokers difficulty reporting brand preference 
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British Journal 
of Addiction 
(1991. volume 
86 , p. 1467- 
1476) 


230 daily 
cigarette 
smokers (141 
male and 89 
female, 

average of 21.4 
years) 


One session 


* Factor 1 scale items - reflected primarily intention and 
desire to smoke, and anticipation of pleasure from smoking * 
Factor 2 scale items - comprised primarily of anticipation of 
relief from negative affect and nicotine withdrawal, and 
urgent and overwhelming desire to smoke 
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* The total Fagerstrom Tolerance Questionnaire score was related to 

saliva cotinine, as were six of the seven individual FTQ items * The item 

, . . . , . "Do you inhale?" exhibited either negative or modestly positive 

Item characteristics, mtentem co,relations, internal consistency, and item-to-total assocMons with other scale itcms and did not sllow a consi5tent 

scorn coirelations computer, Pearson product-moment correlation coefficients were rela||onshi tQ cotinine leve!s * The Qonbach alpha estimate of internal 
used to assess the relationships between the fTQ total and component item scores and ^ for the seven items was 0 .70; omission 0 f the inhalation item 
cotinine levels; boxplots used to .^aph.ca% depict fte associations between cotinine ^ ^ ^ ^ minima]ly l0 0 . 7] * I(ems m showed 

^ the greatest differences of cotinine across response categories were "How 

many cigarettes a day do you smoke?" and ""How soon after you wake up 
do you smoke your first cigarette?" 


* Data from the questionnaire were analysed with exploratory factor analyses using 
principle axis extraction for factor determination with squared multiple correlations 
as communality estimates in an attempt to help identify the basic structure of the 
verbal report on smoking urges * Assessments of variables that might be related to 
various components of reported smoking urges (e.g. smoking history', reported 
reasons for smoking, mood and smoking withdrawal) were included in the study in 
order to aid in the interpretation of factors that emerged from the analysis; stepwise 
multiple regression and ANQVAs used 


* Factor analyses showed that a two-factor solution best described the 
item structure for each of the three deprivation levels ( 0 , 1 , or 6 hours) 
and for the entire sample * Factor scales of 15 and 11 items were highly 
reliable and moderately correlated * Average scores on both scales 
increased significantly with level of deprivation and the Factor 1 scale 
was significantly higher than the Factor 2 scale at all levels * The 
addiction score from the RFS, the Physical Symptoms scale from the 
WSC, and the Boredom score from the RFS questionnaires were 
significant predictors of the QSU general scores * Factor I scores were 
associated positively with a stereotyped smoking pattern and a report of 
being less sleepy on the Stimulation/Sedation scale * Factor 2 scores 
were associated positively with a self-reported tendency to smoke when 
experiencing negative affect, greater sleepiness, and a self-reported 
tendency to feel uncomfortable or experience desires to smoke when 
cigarettes were unavailable 
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Vogt, T.M., Preventive 

Selvin, S., Medicine 
arui Hulley, (1979, volume 
S.B. 8, p. 21-33) 


142 males 


One time 


To examine the 
association between 
seventeen variables from 
a smoking questionnaire 
and levels of expired air 
CO and of serum SCN 


* SCN and CO measurement - combined by calculating the 
first principal component termed the SCN + CO index, 
subtracting their mean values and dividing by their standard 
deviations 
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Correlation, regression, and analysis of covariance techniques were employed to 
analyze the relationships among the biochemical measurements and 17 variables 
abstracted from the subjects' reported smoking history 


* Of the seventeen variables on the questionnaire, cigarette smoking 
frequency was the strongest predictor of the biochemical results; it 
accounted for 24% of the variance in an index that combined the SON 
and CO values * Only two other questionnaire variable contributed 
additional information in a stepwise multiple regression analysis: the time 
elapsed since last smoking and the longest period the smoker had been off 
cigarettes in the past * Conventional questionnaire estimates of dosage 
such as depth of inhalation, the amount of each cigarette smoked, and the 
use of filters did not contribute significant information to the multiple 
regression of SCN and CO 
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